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Abstract: We study two of the simple rules on finite graphs under the 
death-birth updating and the imitation updating discovered by Ohtsuki, 
Hauert, Lieberman, and Nowak [Nature 441 (2006) 502-505]. Each rule 
^H ' specifies a payoff-ratio cutoff point for the magnitude of fixation probabili- 

ties of the underlying evolutionary game between cooperators and defectors. 
We view the Markov chains associated with the two updating mechanisms 
C^ , as voter model perturbations. Then we present a first-order approxima- 

tion for fixation probabilities of general voter model perturbations on finite 
graphs subject to small perturbation in terms of the voter model fixation 
probabilities. In the context of regular graphs, we obtain algebraically ex- 
plicit first-order approximations for the fixation probabilities of cooperators 
distributed as certain uniform distributions. These approximations lead to 
a rigorous proof that both of the rules of Ohtsuki et al. are valid and are 
sharp. 
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1. Introduction 



The main object of this paper is to investigate the simple rules for the evolution 
C^ I of cooperation by clever, but non-rigorous, arguments of pair-approximation 

on certain large graphs in Ohtsuki, Hauert, Lieberman, and Nowak [18]. For 
convenience, we name these rules and their relatives comprehensively as benefit- 
to-cost rules (abbreviated for h/c rules) for reasons which will become clear 
later on. The work [18] takes spatial structure into consideration and gives 
an explanation with analytical criteria for the ubiquity of cooperative entities 
observed in biological systems and human societies. (See also the references in 
[18] for other models on structured poplations.) In particular, this provides a 
way to overcome one of the major difficulties in theoretical biology since Darwin. 
(See Hamilton [8], Axelrod and Hamilton [3], Chapter 13 in Maynard Smith [14], 
and many others.) 
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We start by describing the evolutionary games defined in [18] and set some 
definitions. Consider a finite, connected, and simple (i.e. undirected and without 
loops or parallel edges) graph G = (V, E) on N vertices. (See, e.g., [4] for the 
standard terminology of graph theory.) Imagine the graph as a social network 
where a population of TV individuals occupy the vertices of G and the edges 
denote the links between the individuals. The population consists of cooperators 
and defectors labelled by I's and O's, respectively. Their fitness is described 
through payoffs from encounters as follows. Consider a 2 x 2 payoff matrix: 

Here, while positive constants are natural candidates for both benefit b and cost 
c, we allow arbitrary reals for their possible values unless otherwise mentioned. 
Each entry Ily of 11 denotes the payoff that an i-player receives from a j-player. 
Hence, the payoff of a cooperator is bn— ck if n of its k neighbors are cooperators, 
and the payoff of a defector is bm if m of its neighbors are cooperators. Then 
the fitness of an individual located at x is given by a convex combination of the 
baseline fitness with weight 1 — w and its payoff with weight w. The baseline 
fitness is normalized to 1 for convenience. The parameter w is interpreted as 
the intensity of selection. Therefore, weak selection means that payoff is a 
small proportion of fitness compared to the baseline fitness. 

In contrast to game theory where strategies are decided by rational players, 
evolutionary game theory considers the random evolution of interacting play- 
ers in which the "fitter" strategies have better chances to replicate. We study 
two of the updating mechanisms under weak selection in [18] for the evolution 
of cooperation throughout our work. Under the death-birth updating, we kill 
a random individual and then let its neighbors compete for the vacant vertex 
with success probability proportional to the fitness of its neighbors. Under the 
imitation updating, a random individual updates its strategy, but now it will 
either adhere to its original strategy or imitate one of the neighbors' strate- 
gies with success probability proportional to fitness. In this way, each updating 
mechanism defines a Markov chain on configurations consisting of I's and O's, or 
more specifically, a spin system in the sense of Liggett [11] where each vertex can 
adopt only two possible opinions 1 and 0. Despite the simplicity of the transition 
rates, the readers may observe that the spin systems pose certain difficulty in 
terms of the classical approaches in interacting particle systems. For example, 
as a result of the asymmetry of payoffs, there is no symmetry between I's and 
O's in the two spin systems. In addition, it is not hard to see that in general the 
two spin systems are not attractive. 

We are now ready to describe the b/c rules for the two evolutionary games 
which are surprisingly simple criterions for criticality in the asymptotic. The 
degree of a graph is defined in [18] to be the average number of neighbors per 
vertex. Put a single cooperative mutant on the vertices with a random location. 
Then the clever, but non-rigorous, calculations in (the supplementary informa- 
tion of ) [18], supported by several numerical simulations, lead to the following 
b/c rule for the death-birth updating under weak selection on certain large 
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graphs of degree k: Selection favors cooperation whenever b/c > k, and selection 
opposes cooperation whenever b/c < k. Here, selection favors (resp. opposes) 
cooperation if the probability that a single cooperative mutant converts the de- 
fecting population completely into a cooperative population is strictly higher 
(resp. lower) than the fixation probability 1/N of a neutral mutant. (See (2.8) 
for the latter probability. Eq. (2.8) also shows that if in particular the graph is 
regular, then the fixation probability of a neutral mutant at an arbitrary loca- 
tion without further randomization is precisely i/N.) A similar b/c rule under 
the imitation mechanism is discussed in the supplementary information of [18], 
with the modification that the cutoff point k should be replaced by k + 2. We 
remark that the work [18] also considers the birth-death updating (in contrast 
to the death-birth updating) and its associated b/c rule. See [21] for a further 
study of these b/c rules. For more b/c rules, see [8], [16], and [20], to name but 
a few. The monograph [17] gives an authoritative and excellent introduction to 
evolutionary dynamics. 

Lying at the heart of the work [18] to obtain selective advantage of cooper- 
ators is the introduction of structured populations. This is manifested by the 
role of a fixed degree as population size becomes large. Consider instead a naive 
model where only fractions of players in a large population are concerned and 
the same payoff matrix (1.1) is in effect for evolutionary fitness. The fractions zc 
and zd of cooperators and defectors are modeled through replicator equations 
as 

ic=^ciPc-p). ^^2) 

ZD ^ZD [PD - P) ■ 

Here, by the equality zc + zd — 1, the payoffs for cooperators and defectors are 
PC ~ bzc — c and pn = bzc, and p is the average payoff given by zcpc + zopn- 
By (1.2), the fraction of cooperators satisfies the following logistic differential 
equation: 

Zc = ~czc{l - Zc). 

Hence, any proper fraction of cooperators must vanish eventually whenever cost 
c is positive. See, for example. Chapter 7 in [10], Chapter 4 in [17], or Section 3 in 
[9] for this model and more details. As discussed in more detail later on, a similar 
result holds in any unstructured population of finite size under the death-birth 
updating. Informally, a spatial structure, on one hand, promotes the formation 
of cliques of cooperators which collectively have a selective advantage and, on 
the other hand, reduces the exploitation of cooperators by defectors. 

In [19], Ohtsuki and Nowak gave a rigorous proof of the b/c rules on large 
cycles under weak selection in particular for the two updating mechanisms. The 
results in [19] exploit the fact that on cycles the fixation probabilities under 
each updating mechanism satisfy a system of birth-death-process type difference 
equations, and exact fixation probabilities can be derived accordingly. It is easy 
to get the exact solvability of fixation probabilities by the same approach on 
complete graphs, although on each fixed one of these graphs cooperators are 
always opposed under weak selection for the death-birth updating. (See [18] 
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and Remark 1.1 (3). Note that the degree of a complete graph has the same 
order as the number of vertices.) It seems, however, harder to obtain fixation 
probabihties by extending this approach beyond cycles and complete graphs. 

In this work, we will view each of the two spin systems as a voter model 
perturbation on a (finite, connected, and simple) graph of arbitrary size. Voter 
model perturbations are studied in Cox and Perkins [6] and further developed 
in generality in Cox, Durrett and Perkins [7] on transient integer lattices Z'* for 
d > 3. On the infinite lattices considered in [7], (often sharp) conditions, based 
on a related reaction diffusion equation, were found to ensure the coexistence 
of I's and O's, or to ensure that one type drives the other out. In particular, a 
rigorous proof of the b/c rule under the death-birth updating on these infinite 
graphs is obtained in [7]. Here, in the context of finite graphs, the voter model 
perturbation associated with each of the spin systems fixates in one of the the 
two absorbing states of all I's or all O's, and we give a first-order approximation 
to the fixation probabilities by expansion. In spite of the apparent differences 
in the settings, there are interesting links between our fixation probability ex- 
pansions and the reaction diffusion equation criteria in [7]. 

Let us now introduce voter model perturbations as a family of spin systems. 
Denote by a; a vertex and by ry a configuration. Let c{x, rj) be the flipping rate 
of the (nearest-neighbor) voter model at x given rj. Hence, c{x, rj) is equal to 
the probability of drawing a neighbor of x with the opposite opinion to that of 
X. Then interpreted narrowly in the context considered in this paper, the rates 
of a voter model perturbation are given by 

c'"(a;,7?) = c{x,T]) +whi_^(^){x,T]) + w'^gu.ix,'/]) > (1.3) 

for a small perturbation rate w > 0. Here, hi, ho, and gw for all w small are 
uniformly bounded. We refer the readers to Chapter V in [11] here and in the 
following for the classical results of voter models and to Section 1 in [7] for a 
general definition of voter model perturbations on transient integer lattices. 

We discuss in more details the aforementioned result in [7] which is closely 
related to the present work. A key result in [7] states that on the integer lattices 
Ii'^ for d > 3, the invariant distributions of a voter model perturbation subject 
to small perturbation can be determined by the reaction function through a 
reaction-diffusion PDE. (See Section 1.2 in [7].) Here, the reaction function 
takes the form 

w^ lim /i?(0,7])P^„(e. ed?7) we [0,1], (1.4) 

where ((Cs),P^„) denotes the voter model starting at the Bernoulli product 
measure /i„ with density ^„(77(a;) = 1) = u, and the difference kernel D is 
defined by 

D{x,T]) =rj{x)hi{x,r]) - ri{x)ho{x,r]) (1.5) 

with fj{x) = 1 — ri{x). By the duality between voter models and coalescing 
random walks, the reaction function defined by (1.4) can be expressed explicitly 
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as a polynomial with coefficients consisting of coalescing probabilities of random 
walks. 

The justification in [7] of the b/c rule for the death-birth updating on transient 
integer lattices is under a slightly different definition, for the sake of adaptation 
to the context of infinite graphs. Precisely, the result in [7] states that whenever 
b/c > k (resp. b/c < k) and there is weak selection, given infinitely many 
cooperators (resp. defectors) at the beginning, any given finite set of vertices 
will become occupied by cooperators (resp. defectors) from some time onwards 
almost surely. Here, k refers to the degree of each vertex in the underlying lattice 
and is equal to 2d on Z'^. The b/c rule under the imitation updating on the same 
integer lattices is verified in [5], under the same definition in [7] except that, as 
pointed out in [18], the cutoff point k needs to be replaced by fc + 2. 

We now discuss our result for voter model perturbations on (finite, connected, 
and simple) graphs of arbitrary size. We first work with discrete-time Markov 
chains of the voter model perturbations. We assume in addition the chain start- 
ing at any arbitrary state is eventually trapped at either of the two absorbing 
states, the all-1 configuration 1 and the all-0 configuration 0. This is a property 
enjoyed by both updating mechanisms under weak selection. We proceed ana- 
lytically and decompose the transition kernel P'^ of a voter model perturbation 
with perturbation rate w as the sum of the transition kernel P of the voter 
model and a signed kernel K^ . We apply an elementary expansion to finite-step 
transitions of the P^-chain in the spirit of Mayer's cluster expansion [13] in 
statistical mechanics. Then we show every linear combination of the fixation 
probabilities of 1 and subject to small perturbation admits an infinite series 
expansion closely related to the voter model. A slight refinement of this expan- 
sion leads to our main result for the general voter model perturbations on which 
our study of the b/c rules relies. 

Precisely, our main result for the voter model perturbations on finite graphs 
(Theorem 3.8) can be stated as follows. Regard the voter model perturbation 
with perturbation rate w as a continuous-time chain (^g) with rates given by 
(1.3). Recall by our assumption that the chain starting at any state is eventually 
trapped at either of the absorbing states 1 and 0. Define ti for the time to the 
absorbing state 1 and 

i?(0 = E^(-^'^M^)' (1-6) 

for any H{x, ^). Here, tt{x) is the invariant distribution of the (nearest-neighbor) 
random walk on G given by 

/ N d(x) 
A^) = ^ (1.7) 

with d{x) being the degree of x, i.e., the number of neighbors of x. (See. e.g., [1] 
and [12] for random walks on graphs.) Then as w — > 0+, we have the following 
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approximation: 

/"OO 

P'" (ri < oo) = P (n < c5o) + w / E[D{(s)]ds + 0{w^). (1.8) 

Jo 

Here, P™ and P (with expectation E) denote the laws of the voter model pertur- 
bation with perturbation rate w and the voter model, respectively, both subject 
to the same, but arbitrary, initial distribution, and D is the difference kernel 
defined by (1.5). Moreover, the integral term on the right hand side of (1.8) 
makes sense because -D(^s) G Li(cflP(g) ds). 

We apply the first-order approximation (1.8) to the two evolutionary games 
only on regular graphs. (A graph is a fc-regular if all vertices have the same 
degree k and a graph is regular if it is fc-regular graph for some k.) Under weak 
selection, the approximation (1.8) implies that we can approximate P'"(ri < oo) 
by P(ti < oo) and the 0-potential of D: 

/•oo 

/ E [DiQ] ds, (1.9) 

JQ 

all subject to the same initial distribution. Moreover, the comparison of P"'(ri < 
oo) for small w with P(ti < oo) is possible whenever the 0-potential is nonzero, 
with the order determined in the obvious way. For notions to be introduced 
later on, we take as initial distribution the uniform distribution u„ on the set 
of configurations with exactly n many I's, where 1 < n < N — 1. Each 0- 
potential in (1.9) starting at u„ can be derived from the same 0-potentials 
starting at Bernoulli product measures ^„ with density u € [0, 1]. Furthermore, 
each 0-potential with starting measure /i„ can be expressed in terms of some 
(expected) coalescing times of coalescing random walks. This is in contrast to the 
involvement of coalescing probabilities for the reaction functions in the context 
in [7]. By resorting to a simple identity in [1] between meeting times and hitting 
times of random walks, we obtain explicit forms of the coalescing times involved. 
Hence, by (1.8), we obtain the fixation probabilities explicit up to the first-order 
term, and the precise result is stated as follows. 

Theorem 1. Let G he any (finite, connected, and simple) graph on N vertices. 
Suppose in addition that G is k-regular, that is, every vertex of G has precisely 
degree k. Fix 1 < n < TV — 1 and let P™ denote the law of the particular 
evolutionary game with small intensity of selection w and initial distribution 



(1) Under the death-birth updating, we have 



--„(n<(^)=^ 



0+. 



kn{N - n) 



2N{N - 1) 



^^)(^-^)+<^2 
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(2) Under the imitation updating, we have 



(ri < oo) =^+w 



k{k + 2)n{N -n) 



2{k + l)N{N - 1) 
^ c)iN-l) 



(fc + 2) 



(2k + l)b~ck 
fc + 2 



+ 0{w'), 



0+. 



Here, in either (1) or (2), we use Landau's notation 0{w^) for a function 6(w) 
such that \0{w)\ < Cw^ for all small w, for some constant C depending only on 
the graph G and the particular updating mechanism. 

Before interpreting the result of Theorem 1 in terms of evolutionary games, 
we first introduce the following definition which is stronger than that in [18]. We 
say selection strongly favors (resp. opposes) cooperation if for every nontrivial 
n, that isl<ri<iV— 1. the following holds: The probability that n cooperative 
mutants with a joint location distributed as u„ converts the defecting population 
completely into a cooperative population is strictly higher (resp. lower) than 
n/N . (Here, n/N is the fixation of probability of n neutral mutants again by 
(2.8).) Under this definition. Theorem 1 yields simple algebraic criteria for both 
evolutionary games stated as follows. 

Corollary 1. Suppose again that the underlying social network is a k-regular 

graph on N vertices. 

(1) For the death-birth updating, if 



^^)(^-^) + ^fi-2 



> {resp. < 0), 



then selection strongly favors (resp. opposes) cooperation under weak selection. 
(2) For the imitation updating, if 



c\{N-l) 



{2k + l)b-ck 



> {resp. < 0), 



(fc + 2) J' ' fc + 2 

then selection strongly favors (resp. opposes) cooperation under weak selection. 

Applied to cycles, the algebraic criteria in Corollary 1 under the aforemen- 
tioned stronger definition coincide with the algebraic criteria in [19] for the 
respective updating mechanism. See also Eq. (3) in [21] for the death-birth up- 
dating. 

As an immediate consequence of Corollary 1, we have the following result: 

Corollary 2. Fix a degree k. 

(1) Consider the death-birth updating. For every fixed pair (6, c) satisfying b/k > 
c (resp. b/k < c), there exists a positive integer Nq such that on any k-regular 
graph G = (V, E) with #V > Nq, selection strongly favors (resp. opposes) coop- 
eration under weak selection. 



Yu-Ting Chen/Sharpness of Two Simple Rules 



(2) Consider the imitation updating. For every fixed pair {b,c) satisfying b/{k + 
2) > c (resp. b/{k + 2) < c), there exists a positive integer Nq such that on 
any k-regular graph G = iy , E) with #V > A^O; selection strongly favors (resp. 
opposes) cooperation under weak selection. 

In this way, wc rigorously prove the validity of the b/c rule in [18] under 
each updating mechanism. It is in fact a universal rule valid for any nontrivial 
number of cooperative mutants, and holds uniformly in the number of vertices, 
for large regular graphs with a fixed degree under weak selection. 

Remark 1.1. (1) Although we only consider payoff matrices of the special form 
(1.1) in our work, interests in evolutionary game theory do cover general 2x2 
payoff matrices with arbitrary entries. (See, e.g., [18] and [19].) In this case, 
a general 2x2 matrix 11* = {^*j)i,j=ifi is taken to define payoffs of players 
with an obvious adaptation of payoffs under 11. For example, the payoff of a 



cooperator is (11*;^ 



nto)n 



fcn*Q if n of its k neighbors are cooperators. In 



particular, if 11* 
Sigmund [15]): 



satisfies the equal-gains-from-switching condition (Nowak and 



TT* _ TT* — TT* — IT* 

-"--■-ii -'--'-lo ^ -'-'-01 -'-'oo 



(1.10) 



then the results in Theorem 1, Corollary 1, and Corollary 2 still hold for 11* by 
taking 11 in their statements to be the "adjusted" payoff matrix 



n" 



TT* — TT* TT* 
J^J^ii ^ho ^ho 

TT* — TT* 



TT* 



(1.11) 



which is of the form in (1.1). See Remark 5.1 for this reduction. 

(2) We stress that when ri = 1 or A^ — 1 and the graphs are vertex-transitive 
[4] (and hence regular) such as tori, the exact locations of mutants become 
irrelevant. It follows that the randomization by u„ is redundant in these cases. 

(3) Let G be the complete graph on N vertices so that the spatial structure 
is irrelevant. Consider the death-birth updating and the "natural case" where 
benefit b and cost c are both positive. With the degree k set equal to TV — 1, 
Theorem 1 (1) gives for any 1 < n < A^ — 1 the approximation 



^;," Jn < c») = - + u; ^ 



N 



2N 



-c{N~2)- 2- 



N 



N -1 



0{w^), 



as w — > 0+. Hence, cooperators are always opposed under weak selection when 
A^ > 3. D 

The paper is organized as follows. In Section 2, we set up the standing as- 
sumptions of voter model perturbations considered throughout this paper and 
discuss their basic properties. The Markov chains associated with the two up- 
dating mechanisms in particular satisfy these standing assumptions, as stated 
in Proposition 2.1 and Proposition 2.2. In Section 3, we continue to work on 
the general voter model perturbations. We develop an expansion argument to 
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obtain an infinite series expansion of fixation probabilities under small pertur- 
bation rates (Proposition 3.2) and then refine its argument to get the first-order 
approximation (1.8) (Theorem 3.8). In Section 4, we return to our study of 
the two evolutionary games and give the proof of Theorem 1. The vehicle for 
each explicit result is a simple identity between meeting times and hitting times 
of random walks. Finally, the proofs of Proposition 2.1 and Proposition 2.2 
that both updating mechanisms define voter model perturbations satisfying our 
standing assumptions are deferred to Section 5. 

2. Voter Model Perturbations 

Recall that we consider only finite, connected, and simple graphs in this paper. 
Fix such a graph G = (V, E) on iV = #V vertices. Write x ^ y ii x and y are 
neighbors to each other, that is, if there is an edge of G between x and y. We 
put d{x) for the number of neighbors of x. 

Introduce an auxiliary number A S (0, 1]. Take a nearest-neighbor discrete- 
time voter model with transition probabilities 

A ^ (2-1) 

P{t],i]) =1- -^2^c{x,T]). 

X 

Here, 77^ is the configuration obtained from 77 by giving up the opinion of rj at 
X for 

fj{x) := 1 — ry(a;) 

and holding the opinions at other vertices fixed, and we set 

#{y^x;f]{y) ^vix)} 



c{x,r]) 



d{x) 



We now define the discrete-time voter model perturbations considered through- 
out this paper as follows. Suppose that we are given functions hi and g^ and a 
constant wo G (0, 1) satisfying 

sup ('|/ii(x,77)|-f |/io(a;,?7)| + |.g„,(a-,ry)|] < Co <oo. (Al) 

c"" {x, 77) :=c(x, 77) + whi_,,(^^) {x, 77) -I- w'^gw (a;, 77) > 0, (A2) 

c"" (x, 1) =c'" (cc, 0) = for each a; € V, (A3) 

for each w £ [0,wo]- Here, 1 and denote the all-1 configuration and the all- 
configuration, respectively. In (A2), we set up a basic perturbation of voter 
model rates up to the second order. In terms of the voter model perturbations 
defined below by c'"(a;,77). we will be able to control the higher order terms in 
an expansion of fixation probabilities with the uniform bound imposed in (Al). 
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The assumption (A3) ensures that the voter model perturbations have the same 
absorbing states 1 and as the previously defined voter model. 

Under the assumptions (A1)-(A3), we define for each perturbation rate w G 
[0, Wo] a voter model perturbation with transition probabilities 

X (2-2) 

X 

(Here, we assume without loss of generality by (Al) that each P'^{rj, •) is truly 
a probability measure, in part explaining the need of the auxiliary number A.) 
In particular P" = P. 



Notations We shall write V^ for the law of the voter model perturbation with 
perturbation rate w and initial distribution v and set P^ := P^. In particular 
we put P™ := P^ and P^ := P^^, where (5^ is the Dirac measure at r]. The 
discrete-time and continuous-time coordinate processes on {1,0}^ are denoted 
by (Cn! "■ > 0) and {£,s\s > 0), respectively. Here and in what follows, we abuse 
notations to read 'n' and other indices for the discrete time scale and 's' for the 
continuous time scale, whenever there is no risk of confusion. 

Our last assumption which is obviously satisfied by the P- voter model thanks 
to the connectivity of G is: 

P;;(Cn G {1, 0} for some n) > for every r/ G {1, 0}^ (A4) 

for each w G (0,wo]. Since 1 and are absorbing by the condition (A3), it 
follows from the Markov property that the condition (A4) is equivalent to the 
condition that the limiting state exists and can only be either of the absorbing 
states 1 and under P"' for any w G (0, wq]. 

Proposition 2.1 ([7]). Suppose that the graph is k-regular. Then the Markov 
chain associated with the death-birth updating with small intensity of selection 
w is a voter model perturbation with perturbation rate w satisfying (Al)-(A^) 
with A = 1 and 



Here, 



hi^~ib + c)kfofi + kbfoo + kfo (fe/ii - bfoo) , 



Mx, v) =-^#{2/; y^x, r]{y) = i}, 
fij{x,ij) =—4f{{y,z);x^y^ z, r]{y) =i,T]{z) = j}. 



(2.3) 



(2.4) 
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Proposition 2.2. Suppose that the graph is k-regular. Then the Markov chain 
associated with the imitation updating with small intensity of selection w is 
a voter model perturbation with perturbation rate w satisfying (Al)-(A4) with 
A = j^ and 

h, =k[{b - c)fn - c/io] - rTT/i[(& - c)/ii - c/io + 6/01] - j^bf? 

K + 1 fc + 1 

ho =kbfoi - -;——Mib - c)/ii - c/10 + bfoi] - -p— -/o[(6 - c)/i - c/o], 
A; + 1 K + 1 

(2.5) 

where fi and fij are as in (2.4)- 

The proofs of Proposition 2.1 and Proposition 2.2 are deferred to Section 5. 

The assumptions (A1)-(A4) are in force from now on. 

Let us consider some basic properties of the previously defined discrete-time 
chains. First, as has been observed, we know that 

1 = P'" (ri A To < 00) = P'"(ti < 00) + P"'(ro < 00), 

where we write r,, for the first hitting time of ij. Observe tlrat F"'(ti < 00) is 
independent of the auxihary number A > 0. Indeed, the holding time of each 
configuration 77 7^ 1, is finite and the probability of transition from 77 to 77^ at 
the end of the holding time is given by 

c'^{x,rj) 



which is independent of A > 0. 

We can estimate the equilibrium probability P'"(ri < 00) by a "harmonic 
sampler" of the voter model from finite time. Let pi(^) be the weighted average 
of I's in the vertex set: 

Pi{tl) ^^'n{x)Tr{x), (2.6) 

X 

where ■k{x) is the invariant distribution of the (nearest-neighbor) random walk 
on G and is given by (1.7). Since pi(l) = 1 — Pi(0) = 1 and the chain is 
eventually trapped at 1 or 0, it follows from dominated convergence that 

lim E"'bi(C„)]=P'"(ri<cx3). (2.7) 
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On the other hand, the function pi is harmonic for the voter model: 
lE^[Pi(6)]=PiW+ ^ 



N ■2#E 
x| Yl #{y ~ 2;; 7?(y) = 1} - Y^ #{y ^ x; 7?(2/) = 0} 

^7^(2;)— r){x) — l 

In particular, (2.7) applied to w = entails 

P,(n<oo)=Pi(,y) = 5!^M|^, (2.8) 

where the last equality follows from the explicit form (1.7) of tt. 

Remark 2.3. Since every harmonic function / for the voter model satisfies 

/(r7) = E,[/(e,,^,J], 

(2.8) implies that the vector space of harmonic functions is explicitly charac- 
terized as the span of the constant function 1 and pi . Recall also the foregoing 
display gives a construction of any harmonic function with preassigned values 
at 1 and 0. (See, e.g., Chapter 2 in [1].) D 

3. Expansion 

We continue to study the discrete-time voter model perturbations defined in 
Section 2. For each w € [0,100], consider the signed kernel 

j^w _ pw _ p 

which measures the magnitude of perturbations of transition probabilities. We 
also define a nonnegative kernel \K'^\ by \K'^\{ri,ri) = \K'^'{ii,rj)\. 

Lemma 3.1. For any w S [O,it;o] (md any f : {1,0} — > M. we have 

K'^'m = ^E t^^i-'K-)(^''?) + "''5»(a;,ry)] [firf)~f{7^)] (3.1) 

X 

and 

|||if'"|/L<4CoHl/lloo, (3.2) 

where C'o is the constant in (Al). 
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Proof. We notice that for any 77 and any x, 

K'"(v,v'') =-^ [whi_,^(^^',(x,ri) + w'^gu,{x,r])] , 
K"" (?7, r/) = - ^ — [u;/ii_^(^) (x, 7?) + w^Qn, {x, r/)] , 

X 

by the definitfons of d" and P'". Our assertions (3.1) and (3.2) then foUow at 
one stroke. D 

Using the signed kernel K^' , we ean rewrite every T-step transition probabil- 
ity Py of the voter model perturbation as 

Prim, Vt) = Y. P'"iVo,m)P"'im,m) ■ ■ ■ P'^'iVT-uVr) 

771, ■■■ -JlT-l 

= J2 iP + Knirio,rn)---iP + KniriT-i,VT) 



T 



^PTivo,VT) + J2 E E ^THmr--,VT). (3.3) 

Here, ^^(ri) is the set of strictly increasing ri-tuples with entries in {1, • • • ,r}, 
and for j = (j^, • • • , j„) e Xt("-) 

^THm.---.m) (3.4) 

is the signed measure of the path (770, iji,- ■ ■ , tit) such that the transition from 
r]r to rjr+i is determined by K'"{rjr, t^^+i) if r + 1 is one of the (integer- valued) 
indices in j and is determined by P{rir, ?/r+i) otherwise. For convenience, we set 
for each j E It (n) 



"'\vo,Vt)= Y A^'J(77o,--- ,77t) 



as the T-step transition signed kernel, and we say Q^'"' has n faults (up to 
time T) and j is its fault sequence. Then by (3.3), we can write for any 
/:{1,0}V— ^R 

T 

E;[/(eT)]=E,„[/(eT)] + E E E ^Hvor-- ,VT).f{vT) 

J, (3-5) 

=E,J/(eT)] + E E QtV(^o). 

n=ljelT(n) 

Write X(n) = looin) for the set of strictly increasing 77-tuples with entries 
in N. We now state the key result which in particular offers an expansion of 
fixation probabilities. 
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Proposition 3.2. Recall the parameter wq > in the definition of the voter 
model perturbations. There exists wi € (0, wq] such that for any harmonic func- 
tion f for the voter model, 

oo 

/(l)P-(ri < oo) + /(O)P-(ro < oo) = f{rj) + $^ ^^ QZ'V('7), (3-6) 

n=ljGl(n) 

where the series converges absolutely and uniformly in w € [0, wi] and in rj £ 
{1,0^. 

Remark 3.3. (i) There are alternative perspectives to state the conclusion of 
Proposition 3.2. Thanks to Remark 2.3 and the fact Q^'^t = 0, it is equivalent 
to the validity of the same expansion for pi defined in (2.6) (for any small if). 
By Remark 2.3 again, it is also equivalent to an analogous expansion of any 
linear combination of the two fixation probabilities under P™ . 
(ii) The series expansion (3.6) has the flavor of a Taylor series expansion in w, 
as hinted by Lemma 3.6. D 

The proof of Proposition 3.2 is obtained by passing T to infinity for both 
sides of (3.5). This immediately gives the left hand side of (3.6) thanks to our 
assumption (A4). There are, however, two technical issues when we handle the 
right hand sides of (3.5). The first one is minor and is the dependence on T 
of the summands Qr''^ f {rjo) ■ For this, the harmonicity of / implies that such 
dependence does not exist, as asserted in Lemma 3.4. As a result, the remaining 
problem is the absolute convergence of the series on the right hand side of (3.6) 
for any small parameter w > Q. This is resolved by a series of estimates in 
Lemma 3.5, Lemma 3.6, and finally Lemma 3.7. 



Lemma 3.4. For any harmonic function f for the voter model, any T > 1, and 
any j elrin), 

where we identify j e Xj^ (n) in the natural way. 

Proof. This follows immediately from the martingale property of a harmonic 
function / for the voter model and the definition of the signed measures A^'*' 
in (3.4). D 



Lemma 3.5. There exist Ci = Ci{G) > 1 and 5 = 5{G) E (0, 1) such that 

sup P,,(^„ 7^ 1, 0) < Ci(5" for any n > 1. (3.7) 

Proof. Recall that the voter model starting at any arbitrary state is eventually 
trapped at cither 1 or 0. By identifying 1 and 0, we deduce (3.7) from some 
standard results of nonnegative matrices, for suitable constants Ci = Ci(G') > 1 
and 6 G (0, 1). (See, e.g., [2] Lemma L6.1 and Proposition L6.3. ) D 
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Lemma 3.6. Let Ci ~ Ci(G) and 6 ~ 5{G) be the constants in Lemma 3.5, 
and set C ~ C{G,Co) = 'niax{AC'o,Ci). Then for any j CzT{n), any w Cz [0,wo], 
and any harmonic function f for the voter model, 

Q7''f < ||/|loo^«"C2"5J"-". (3.8) 

Proof. Without loss of generality, we may assume ||/||oo = 1- By definition, 

QZ'V(^o)- E A;;J(,yo,---,^,J/(%.). (3.9) 

If A"''"' (770, ■ ■ ■ , rjj^ ) is nonzero, then none of the rjo, ■ ■ ■ , ?7j„-i is 1 or 0. Indeed, 
if some of the ?7i, < i < j„ — 1, is 1, then 77^+1, • • • ,7yj„ can only be 1 by 
(A3) so that K"^ f{rij^^i) — 0, as is a contradiction. Similarly, we cannot have 
rji = for some < i < jn ^ ^- Hence, the non- vanishing summands of the 
right hand side of (3.9) range over A^''' (f?!, • • • , rjj^) f{iij„) for which none of 

the ?7jj , • • • ,%„-! is 1 or 0. With rjo fixed, write A^'^ for the signed measure 

Ay''' restricted to paths starting at ?/o- Thus we get from (3.9) that 

Qr/(^o) - AXio [/(e,ji[6.-.c.„-.#i,oi] . 

Here, our usage of the compact notation on the right hand side is analogous to 
the convention in the modern theory of stochastic processes. Recall that jiiT'"! 
stands for the kernel \K'^\{ri,f]) = \K'^{ri,fj)\, and put |A|"''''jy for the measure 

on paths {i]o, ■ ■ ■ ,riij) obtained by replacing all the K^ in A^';;' by |iir"'|. Since 
||/||cxD = 1, the foregoing display implies 

iQZ'V(%)i<iAi;„l(6,---,G„-i^i,o) 

X sup P,,(Cj„-J„- 

with jo = 0, where sup^_^i_o]F'»7(?in-j„-i-i ¥" IjO) bounds the measure of the 
yet "active" paths from jn~i to j„ — 1 and Hl/f^llH bounds the measure of 
the transition from j„ — 1 to j„ . Iterating the last inequality, we get 

\Qj:^f{vo)\ <||i^'"iiL n ( «^p n(a->-i-i ^ I'O) I 

<(4Co)"u;" n I ™P ^v{U-lr-^-l ^ 1,0) ) , (3.10) 

where the last inequality follows from Lemma 3.1. Since 'Y^=\^3r — jr-i ^ 1) = 
jn — n and C ~ max(4Co,Ci), Lemma 3.5 applied to the right hand side of 
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(3.10) gives 

|g;i'V(%)l<^"(C2)"<5^"-". (3.11) 

This completes the proof of (3.8). D 



Lemma 3.7. Recall the constants C = C{G,Cq) and 5 = 5{G) in Lemma 3.6 
and Lemma 3.5, respectively. There exists Wi € (OjUIq] such that 

^ ^ <(C2)"5^"-" < oo. (3.12) 

n=ljel(n) 

Proof. Observe that every index in lj„^2 -^("') '^^^ ^^ identified uniquely by the 
time of the last fault and the fault sequence before the time of the last fault. 
Hence, letting S denote the time of the last fault and m the number of faults 
within {1, • • • , 5 — 1}, we can write for any w > 

^ Y, z«"(c2)",5-'"-" = Y,Y. r ^ )w"'+\cy^+H^-'''-\ (3.13) 

™=ljGl(n) S=lm=0 ^ ^ 

For each S, write 

o -I 

^ i^m %'"+'(G')™^''5'^"™"' ^wC^S''-^ {l + wCH~^f'' . (3.14) 

771=0 ^ ^ 

With 6 € (0, 1) fixed, we can choose wi £ {0,wo] smaU such that 



1 ^'-' 



for any large 5*. Apply the foregoing inequality for large S to the right hand 
side of (3.14) with w replaced by wi. This gives 

S—l 

m=0 ^ '^ 

where the right hand side converges exponentially fast to as (5 < 1. By (3.13), 
the asserted convergence of the series in (3.12) now follows. D 



Proof of Proposition 3.2. We pick wi as in the statement of Lemma 3.7. By 
Lemma 3.6 and the choice of wi, the series in (3.6) converges absolutely and 
uniformly in w G [0,wi] and i] E {1,0}^. 
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By (3.5) and dominated convergence, it remains to show that 
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li- E E Qt'im-y: E Qr/(^o). 



T-s- 

n=ljGlT(n) n=ljel(n) 

To see this, note that by Lemma 3.4, we can write 

T T 



E E QtV(%)=e E QJ'fM, 



n=ljelT{r. 






where the right hand side is a partial sum of the infinite series in (3.6). The 
vaUdity of (3.6) now follows from the absolute convergence of the series in the 
same display. The proof is complete. D 

For the convenience of subsequent applications, we consider from now on the 
continuous-time Markov chain {^s) with rates given by (A2). We can define this 
chain (^s) from the discrete-time Markov chain (^„) by 



^s = i 



Ms 



where (M^) is an independent Poisson process with ]E[Af5] = ^. (Recall our 
time scale convention: 'n' for the discrete time scale and 's' for the continuous 
time scale.) Under this setup, the potential measure of {£,s) and the potential 
measure of (^„) are linked by 



f{Cs)ds 



TV" 



-E 



E/(^») 



.n=0 



(3.15) 



for any nonnegative /. In addition, the fixation probability to 1 for this continuous- 
time Markov chain (^s) is the same as that for the discrete-time chain (^,i). (See 
the discussion after Proposition 2.2.) 

We now state a first-order approximation of P'^'(ti < oo) by the voter model. 
Recall the difference kernel D defined by (1.5) with hi as in (Al) and the tt- 
expectation D defined by (1.6). 

Theorem 3.8. Let v he an arbitrary distribution on {1, O}'^. Then as w — > 0-I-, 
we have 

/•oo 

P;;(ri <oo) = P,(ti <oo)+w / ¥.,[D{^s)\ds + 0{w^). (3.16) 

Jo 

Here, the convention for the function 0{w^) is as in Theorem 1. Moreover, 
D{^s)eLi{dF^(g)ds). 

Proof. It suffices to prove the theorem for i/ = 6,^^ for any 770 G {1,0}^. Recall 
that the function pi defined by (2.6) is harmonic for the voter model and hence 
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the expansion (3.6) applies. By (3.8) and Lemma 3.7, it is plain that 
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n=2jel(„) 



'"'V(^o) = 0(^'). 



(3.17) 



We identify each j £ X(l) as j = (j) = j and look at the summands Qj'^'pi- 
Write E'"'-' for the expectation of the time-inhomogeneous Markov chain where 
the transition of each step is governed by P except that the transition from j — 1 
to j is governed by P™ . Then 



=E,„^E-._Jpi(ei)]-E4^.„Jpi(ei)] 

.E,„[if>i(C,_i)] 
.E„„[if>i(C,_i);riAro>j], 



(3.18) 



where the last equality follows from the definition of K^" and the fact that 1 
and are both absorbing. Moreover, we deduce from Lemma 3.1 that 



where 



K^Piiv)^^wDi7^) + ^w'GUv), 



Gw {x, rj) =g.u, {x, t]) {1 - 2t]{x)) . 



(3.19) 



Note that E,,„[ti A tq] < oo by Lemma 3.5. Hence by (3.18) and (3.19), we 
deduce that 

oo . oo 



i=i 



J=l 



=wE, 



no 



Di^s)ds 



+ Oiw'), 



(3.20) 



where the last equality follows from (3.15). Moreover, D{£^s) G Li{dPr]o ® ds). 
The approximation (3.16) for each w < W2 for some small W2 G (O,^;!] now fol- 
lows from (3.17) and (3.20) applied to the expansion (3.6) for pi. This completes 
the proof. D 



4. First-Order Approximations 

In this section, we give the proof of Theorem 1. We consider only regular graphs 
throughout this section. (Recall that a graph is regular if all vertices have the 
same number of neighbors.) 

As a preliminary, let us introduce the convenient notion of Bernoulli trans- 
forms and discuss its properties. For each u € [0,1], let /x„ be the Bernoulli 
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product measure on {1,0} with density ^u{£,{x) = 1) = m. For any function 
/ : {1, 0}^ — > M, define the Bernoulli transform of / by 



'' 11=0 



»):#{a:;';(2;) = l}=n 



u^{l-u) 



N-n 



ue [0,1]. 

(4.1) 



The Bernoulli transform of / uniquely determines the coefBcients 
Afin):= Yl /(^)' 0<7i<7V. 

ri:#{x:ri{x) = l}=n 

Indeed, ^/(O) = /(O) = Af{0) and for each l<n<N, 

Afin) = hm i^ (miu) - '£ ^^(1 - ur-'^Af{^)] . 



uiO+ u 



4=0 



^N 



The Bernoulli transform S§f{u) is a polynomial X)i=o ^i'^^ '^^ order at most 
N . Let us invert the coefficients Af{n) from ai by basic combinatorics. By the 
binomial theorem. 



n=0 ^ 



N-i-r 



Hence, summing over i + n, we have 

N N 



E"»"' = E 



i=0 



.1=0 



A^-i 



w"(l-u) 



Af-n 



and the uniqueness of the coefficients Af implies 



^/W = E 

i=0 

As a corollary, we obtain 

/I 1 ■ '\ 

/du„ = -p-A/(n) = -p-^ 



wi/ j=0 



< 71 < iV. 



N - i\ 
a,,\ .1, 1<72<N~1, 

n — I 



(4.2) 



(4.3) 



if we regard u„ , the uniform distribution on the set of configurations with pre- 
cisely n many I's, as a measure on {1, 0}^ in the natural way. 

We will specialize the application of Bernoulli transforms to the function 



/■OO 

/(ry) := / E„ [ms)] ds. 
Jo 
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To obtain the explicit approximations (up to the first order) asserted in Theorem 
1, we need to compute by Theorem 3.8 the 0-potentials /p°° Eu„ [D(^s)] ds for 
1 < n < TV — 1 under each updating mechanism. On the other hand, we wiU see 
that the BernouUi transform of each 0-potential / is analytically tractable and 

.^I{u) = ru{l - u) (4.4) 

for some explicit constant F. Note that we have Aj{N) = Aj{0) = for the 
updating mechanisms under consideration. Hence, the formula (4.3) entails 

^°°Euj:D(6)]d. = ^fc^, l<n<N-l, (4.5) 



smce 



N{N- 1) 
CZI) - (11) - Crf) for n > 2 and (--) = (--) = 1. 



4.I. Proof of Theorem 1 (1) 

Assume that the graph G is fc-regular. Recall that the death-birth updating 
defines a Markov chain of voter model perturbation satisfying (A1)-(A4) by 
Proposition 2.1 under weak selection. The functions hi in (Al) for this updating 
are given by (2.3). Hence, the difference kernel D is given by D{x, ^) = /ii(a;, ^), 
and for any x £ V, 

iE^Ji?(a;,6)] =- (6 + c)E^„[/o/i(a;,6)] +6IE^„[/oo(a:,6)] 



6E^„ [/o/ii(a;, 6)] - V&^.^ [fofooix, ^s)] 

{b + c)E^„ [fofiix, 6)] + bE^^ [fofiiix, 6)] 

bE^.Afifoo{x,Cs)]- 



(4.6) 



In analogy to the computations in [7] for coalescing probabilities, we resort 
to the duality between voter models and coalescing random walks for the right 
hand side of (4.6). Let {B^;x € V} be the rate-1 coalescing random walks on 
G, where B^ starts at x. The random walks move independently of each other 
until they meet another and move together afterwards. The duality between the 
voter model and the coalescing random walks is given by 

F^ iUx) =i.,xeQ)= F{v{Bf) =1^, xe Q) 

for any Q <z\l and {ix\x ^ Q) G {1, 0}*^. (See Chapter V in [11].) Introduce two 
independent discrete-time random walks (Ar„;?i > 0) and iYn\n > 0) starting 
at the same vertex, both independent of {B^;x € V}. Fix x and assume that 
the chains (Xn) and (y„) both start at x. Recall that we write rj = 1 — rj. Then 
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by duality, we deduce from (4.6) that 



b J /.„ {dv)E[f}{B^^ UBl^ UBl^ )] 
b [ f,^idrj)EMB^^MBj^MBj^)] 

fL^{dr^)E[r,{B^-)]+c j fiu{dr^)E[r^{B^-UB'[-)] 



(4.7) 
b I Mu(d^)E[rKi?fO^/(Sr^)] 



+ b j ^i^{dr,)E[r,{Bf-)-r,{B'^-)]. 

For clarity, let us write from now on Pp and Ep for the probability measure 
and the expectation respectively under which the common initial position of 
(X„) and {Yn) is distributed as p. Recall that D{^) is the 7r-expectation of 
X I — > D{x,C) defined by (1.6). Write M^^y = inf{i G R+;Bf = B^} for the 
first meeting time of the random walks -B^ and S^, so B^ and B^ coincide 
after Mj.y. Then from (4.7), the spatial homogeneity of the Bernoulli product 
measures implies that 

-Ep„ \D{^s)\ ^-cu + c[u-p„{Mx,^Y, <s) + u''V^(Mx,,Y^ > s)] 

+ b[uP^{MY,,Y2 <S)+ U^P^iAlY,,Y2 > s)] 

- b[uP^{Mx,,Y, <s) + u'^P^{Mx,.Y^ > s)] 
= - cu{l - u)P^{Mx,,Y, >s)- bu{l - u)P^{My,,y, > s) 
+ bu{l-u)P,,{Mx,,Y2 >s). 

To obtain ^I, we integrate both sides of the foregoing equality with respect to 
s over ]R-|_. This gives 

miu) =kuil - u)( - cE,[A/xi,yJ - 6E,[Afy,^yJ + 6E,[Mxi,fJ) . (4.8) 

We now turn to a simple identity between first meeting times and first hitting 
times. Let Ty ~ inf{n > 0; X„ = y}, the first hitting time of y by (X„). 
Observe that for the random walks on (connected) regular graphs, the invariant 
distribution is uniform and E2;[Ty] = Ey[T2;] for any x,y. Hence, the proof of 
Proposition 14.5 in [1] implies 

B[M,^y] = ^E4Ty] x,yey. (4.9) 
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Write 

f{x,y):=-E,[Ty]^-Ey[T,], x, y S V, 

where E^^ ~ E^^ . 

Lemma 4.1. For any z S V, 

E,[/(Xo,Xi)]=E,[/(yi,r2)] = 7v-i, (4.10) 

I]SiX,,Y,)]=E,[f{Yo,Y2)] = N-2, (4.11) 

E.[/(Xi, y^)] = (^1 + i^ (TV _ 1) + 1 _ 2. (4.12) 

Proof. The proof of the equality E^ [/(Xo, Xi)] = N— 1 can be found in Chapter 
3 of [1] or [12]. We restate its short proof here for the convenience of readers. 
Let r+ = inf{n > 1;X„ = x} denote the first return time to x. A standard 
resuh of Markov chains says E^[r+] = tt{x)^^ = N for any x. The equalities in 
(4.10) now follow from the Markov property. 

Next, we prove (4.11). By (4.10) and the symmetry of /, we have 

N - 1 =E,[/(Xo,Xi)] = Y. ^E.[T,] 

= E E ^ (E«[^-] + 1) = E.[/(Fi,Xi)] + 1, 

SO E^[/(Xi, Fi)] ^ N — 2. Here, our summation notation J2x~z means summing 
over indices x with z fixed, and the same convention holds in the proof of 
(4.12) and Section 5 below. A similar application of the Markov property to the 
coordinate Fi in E^[/(ro,ri)] gives E^[/(ro,y2)] = A^ - 2. This proves (4.11). 
Finally, we need to prove (4.12). We use (4.10) and (4.11) to get 

E4/(Xo,Xi)]=i + E4/(Xi,yi)] 

=i + EE^E.[^.] 

x^z y^z 

-1 + EE^(E^E.[T.] + i] (4.13) 

xr^z y^z \wr^y / 

y^x 

=1 + E E ^ + E E E ^E.[T.] - 5: 5: 1e.[t.] 

xr^z y'^z X'-^z y^z iw-^y x^^z w^x 

y^x 

=2 - i +E,[/(Xi,r2)] - iE,[/(Xi,Xo)]. (4.14) 

Here, in (4.13) we use the symmetry of /, and the last equality follows from 
(4.10). A rearrangement of both sides of (4.14) and an application of (4.10) 
then lead to (4.12), and the proof is complete. D 
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Apply Lemma 4.1 and (4.9) to (4.8), and wc obtain the following result. 
Proposition 4.2. For any u G [0, 1], 



?I{u) 



ku(l — u) 



^^)(^-^)+^(^^ 



(4.15) 



Finally, since 3§I{u) takes the form (4.4), we may apply (4.5) and Proposi- 
tion 4.2 to obtain the explicit formula for the coefficient of w in (3.16), subject 
to each initial distribution u„. This proves our assertion in Theorem 1 (1). 



4.2. Proof of Theorem 1 (2) 

The proof of Theorem 1 (2) follows from almost the same argument for Theorem 
1 (1) except for more complicated arithmetic. For this reason, we will only point 
out the main steps, leaving the detailed arithmetic to the interested readers. In 
the following, we continue to use the notations for the random walks in the proof 
of Theorem 1 (1). 

Fix a; € V and assume the chains [Xn) and (1^) both start at x. By Propo- 
sition 2.2, we have 

iE^„[i?(.T,6)] 
=IE^„ {b-c)S,s{x)fii{x,S^s) ~c£,s{x)fio{x,^s) - b£,s{x)f oi{x,^s) 
- ^IEp„ [[{b - c)fn{x,i,) - cfio{x,^s) +bfoiixAs)) 

(^l{x)f,{x,^s)~U^)fo{x,^s)) 

bUx)f?{x,^,) - U^)fo{x,^s)({b- c)f,{x,^s) - cfo{x,^s)) 

\b - cMB^^MBj^UBj^-) - cv{b^,mbY'MbY-) 

- bij{B^,MBj^UBjn 
((& - cUBj^ HBj^ ) - criiBj^ )f}{BY^ ) + 6^«^ )7y(i?p )) 

x(rKi?f^)-rKi?,^)) 
b^iB^UB^^MBl^) - {b-cUB^)v{Bf^)v{Bi:') 



- 1 E. 

fc + 1 ' " 

'■ / fJ'uidr])l 



E 



fc+1 



-E 



fc + 1 



E 



+ cviB^,MBt^mB^^) , 
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where the last equality follows again from duality. The last equality gives 



^Ef,JD{x,^s)]= f Mdv)^ 



bviBj^MBj^) + |±|,Ki?f)^(i?,rO 



- l^^iB^')v{BYn + j^viBfMB^^) - j^viB'^) 

Recall that Xi = Yi. Hence, by the definition of D and Pjr, the foregoing 
implies that 

-E^„ \D{^s)] = - bu{l - u)P^(My,,y, > s) 
2c + b , ^ , 

b 



^^^u{1-u)P^{Myo,y, >s) 

-^—Yu{1 - u)P^{Mx,,Yi > s) 
kb 



1 



u{l-u)P^{Mx,,Y, >s). 



Again, we integrate both sides of the foregoing display with respect to s and 
then apply (4.9) and Lemma 4.1 for the explicit form of ^/. The result is given 
by the following. 

Proposition 4.3. For any u € [0, 1], 



-«^^n|^ 



' eViV-l) -"' + '""'■' 



(fc + 2) y' ' k + 2 



Our assertion for Theorem 1 (2) now follows from an application of Proposi- 
tion 4.3 similar to that of Proposition 4.2 for Theorem 1 (1). The proof is now 
complete. 

5. Proofs of Proposition 2.1 and Proposition 2.2 

5. 1 . Proof of Proposition 2. 1 

Suppose that ^ G {1, 0}^ is the present configuration on the graph. Let ni{x) = 
ni(a;, ^) be the number of neighboring i players for an individual located at vertex 
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X ioi i — 1,0. Let w e [0, 1] denote the intensity of selection. By definition, the 
fitness Pi{x) ~ pi{x,^) of an i-player located at x is given by 



Pt{x) ^ {I - w) +w[ Uii Uio ] 



ni{x) 
noix) 



{I - w) + wUin{x) (5.1) 



Here, 11^ is the payoff row of an i-player of the matrix 11 and n{x) is the column 
vector [ni{x) hq^x)] . Hence, there exists wq > depending only on k and 11 
such that Pi > for every w € [0,wo]; see [7]. 

The game with the death-birth updating under weak selection defines a 
Markov chain with transition probabilities P™ taking the form (2.2) and 



c"'(a;,e)-ri_^(.)(x,e)>0, 



Y.y^x[piiy)^iy) + Poiy)(iy)] 



(5.2) 
(5.3) 



It has been shown in Section 1.4 of [7] that the rates c"' define voter model 
perturbations satisfying (Al) and (A2). Moreover, A = 1 and the functions hi 
in the expansion (A2) are given by (2.3). Plainly, c'^{x, 1) = ro{x, 1) = and 
c™(a;, 0) = ?-i(a;, 0) = 0. Hence, (A3) is also satisfied. 

It remains to check that (A4) is satisfied. Since (A4) is satisfied when w — 0, 
it is enough to show that 



p(^,r)>o^=^p"'(e,r)>o. 



(5.4) 



for any .J ^ 1, and any x. However, this is immediate from (5.3) if we notice 
that pi(-) and the constant function 1, both regarded as measures on V in the 
natural way, are equivalent. Our proof of Proposition 2.1 is now complete. 

Remark 5.1. Suppose now that payoff is given by a general 2x2 payoff matrix 
n* = (H* )ij=i.o subject only to the 'equal-gains-from-switching' condition 
(1.10). Let us explain how to reduce the games with payoff matrix II* to the 
games with payoff matrix 11° under weak selection, where 11" is defined by 

(l-ll)- ^ 

In this case, payoffs of players are as described in Remark 1.1. and fitness is 
given by 



Pi (x) = (1 - w) + wU*n{x), X e V. 



(5.5) 



Here again, 11* is the payoff row of an i-player. We put the superscript 11* (only 
in this remark) to emphasize the dependence on the underlying payoff matrix 
n*, so in particular the previously defined fitness p in (5.1) is equal to p^. 

Suppose that the graph is fc-regular. The transition probabilities under the 
death-birth updating with payoff matrix II* are defined in the same way as 
before through (5.2) and (5.3) with p replaced by p^ . Note that ni{x)+no{x) = 
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k. Then for all small w 

^ -pf ix) =1 + __-^!___nXx) 



I - {1 - kll*,)w'^' ' ' l-(l-fcn*„)«; 



^T^""''^' 



for some iif . Here, w and w" are defined continuously in terms of each other by 



and 



w 



1 + /sn*(,w 1 - fcnjou;" ' 

so lim^j^-i-o w = lim„,^ow" = 0. Consequently, by (5.2) and (5.3), the foregoing 
display implies that the death-birth updating with payoff matrix 11* and inten- 
sity of selection w is 'equivalent' to the death-birth updating with payoff matrix 
n° and intensity of selection w°, whenever w" or w is small. Here, 'equivalent' 
means equality of transition probabilities. 

A similar reduction applies to the imitation updating by using its formal 
definition described in the next subsection, and we omit the details. D 



5.2. Proof of Proposition 2.2 

Under the imitation updating, the Markov chain of configurations has transition 
probabilities given by 

1 ^^ (5-6) 

j^"'(^,o-i-^E^'"(^'^)' 

X 

where 

d'"(x,e)=si_5(,)(x,e) (5.7) 



Y.y^x Pi{y)^(y)-- 



s,ix,0= ^.~..^... ..^.-^ (5 3) 

T,y^x [piiy)^iy) + poiy)^iy)\ +pi-i{x) 

and the fitness pi are defined as before by (5.1). We assume again that the 
intensity of selection w is small such that pi > 0. To simplify notations, let us 
set the column vectors 

/(x)=[/i(x)/o(.t)]^, 
ni,{x) ^[naix) nio{x)] , 
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where the functions fi and fij are defined by (2.4). By (5.1) and (5.8), we have 

(1 — w)ni{x) + wTlini,{x) 



Si{x,C) 



(1 - w){k + 1) +wJ2]=o'^j'>T'3'i^) + wlli^.in{x) 



Note that the functions fi and fij are uniformly bounded. Apply Taylor's ex- 
pansion in w at to the right hand side of the foregoing display. We deduce from 
(5.7) that the transition probabilities (5.6) takes the form (2.2) with A = -^^ 
and the rates c™ satisfying (Al) and (A2) for some small wq. Moreover, the 
functions hi are given by 

h, = {knj„ fi) - /, ( ^ ^ n,/^.. + ^ni_,/ - i 
=m,J..-^/.||gn,/,.j-^/.n,_,/. 

By the definition of 11 in (1.1), we get (2.5). The verifications of (A3) and (A4) 
follow from similar arguments for those of (A3) and (A4) under the death-birth 
updating, respectively. This completes the proof of Proposition 2.2. 
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